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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply Is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the malting date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to beconne ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )[3 Responsive to communication(s) filed on 17 February 2004 . 
2a)KI This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for fonmal matters, prosecution as to the nnerits is 

closed in accordance with the practice under Ex pa/te Quay/e, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) M Claim(s) 1-27 and 42-66 is/are pending in the application. 

4a) Of the above claim{s) is/are withdrawn from consideration. 

5) 0 Claim{s) is/are allowed. 

6) 13 Claim(s) 1-27 and 42-66 is/are rejected. 

7) n Claim(s) is/are objected to. 

8) 0 Claim{s) are subject to restriction and/or election requirement 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) Including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or fonn PTO-152. 

Priority under 35 U.S.C. § 119 

12) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (0- 
a)n All b)n Some * c)^ None of: 

1 0 Certified copies of the priority documents have been received. 
2Q Certified copies of the priority documents have been received in Application No. 
3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 This action is responsive to communications: Amendment, filed on 2/27/2004. 
This action is final. 

2 Claims 1-27 and 42-66 are pending in this application. Claims 1 and 42 are independent 
claims. In the Amendment, filed on 2/27/2004, claims 28-41 are cancelled, claims 1, 12, 42, and 
53 are amended. 

3. Since the apphcant fails to traverse the examiner's assertion of official notice, official 
notice is taken to be admitted prior art. 

Claim Rejections - 35 USC ^ 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

4. Claims 1-17, 20, 21, 24-27, 42-58, 61-62, and 65-66 are rejected under 35 U.S.C. 102(e) 
as being anticipated by Paroz (US 6,587,125). 

As per claim 42, Paroz teaches a computer system wherein a user controls at least one 
computing element first computing device), the system comprising: 

at least one computing element each having a canonical user interface description 
associated therewith; 

a universal console (second computing device) for controlling at least one computing 
element and storing user preferences therein (col 4, lines 5-1 1); 
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wherein a computing element of at least one computing element communicates its 
associated canonical user interface to the user console; 

wherein the user console generates a concrete user interface description from the user 
interface and the stored user preferences; and 

wherein a user thereafter utilizes the user console to control the computing element via 
the concrete user interface by selecting at least one action-command (col. 3, lines 16-34). 

As per claim 43, Paroz teaches a computer system wherein selecting at least one action 
command includes requesting information about the state of the at least one computing element 
(ability to detect changes in the status of the first computing device) (col. 4, lines 5-1 1). 

As per claim 44, Paroz teaches a computer system wherein a user of a universal console 
interacts with at least one group hierarchy to obtain data in connection with the selected at least 
one action-command to be carried out by the computing element (software intermediaries) (Fig. 
1 &Fig. 2, col 7, lines 5-15). 

As per claim 45, Paroz teaches a computer system wherein the storage of user 
preferences includes the storage of data indicating at least one disability of the user 
(customizable/unique and different from user interface of first apphcation) (col 11, lines 64-67), 

As per claim 46, Paroz teaches a computer system wherein at least one computing 
element canies out at least one action-command (col 1 1, lines 23-54). 

As per claim 47, Paroz teaches computer system wherein the universal console receives 
notification from the at least one computing element (output originating from application in first 
computing device is sent to second computing device) (col. 11, lines 48-51). 
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As per claim 48, Paroz teaches a computer system wherein the notification includes at 
least one of an error message, warning message, status update message and state change (status 
change) (col. 4, lines 17-25). 

As per claim 49, Paroz teaches a computer system wherein the canonical user interface 
description is formatted according to an XMI, stream (col 10, lines 45-51). 

As per claim 50, Paroz teaches a computer system wherein selecting at least one action 
command includes requesting a list of available devices that may be controlled by universal 
console (col, 8, lines 39-45, col 8, lines 61-65). 

As per claim 5 1 , Paroz teaches a computer system wherein communications between the 
universal console and the computing element are made via HTTP (col. 3, lines 21-28). 

As per claim 52, Paroz teaches a computer system wherein the computing element is one 
fi'om the group of a computing device and an application (group includes mobile phone, pda, 
etc.) (col. 3, lines 28-34). 

As per claim 53, Paroz teaches a computer system wherein the remote procedure call 
mechanism makes calls according to the Simple Object Activation Protocol (other Internet 
protocols other than HTTP are used/acceptable) (col. 7, lines 46-62). 

As per claims 54 and 55, Paroz teaches a computer system wherein the canonical user 
interface description includes a description associated with a parameter for choosing one element 
a from a set A and a description associated with a parameter for selecting a subset ,4 * from a set 
A (personal digital assistant has single element and multiple element selection capabilities) 
(col.7, lines 40-46). 
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As per claim 56, Paroz teaches a computer system wherein the canonical user interface 
description includes a description associated with a parameter for selecting one from the group of 
True/False, Offi^On, OK/Cancel and Yes/No (col. 3, lines 15-20, col. 1, lines 59-61). 

As per claim 57, Paroz teaches a computer system wherein the canonical user interface 
description includes a description associated with a parameter for selecting an integer n in the 
range n 1 through n2, with an increment (increment window size, font, etc) (col 13, lines 1-5). 

As per claim 58, Paroz teaches a computer system wherein the canonical user interface 
description includes a description associated with a parameter for selecting a real number x in the 
range xl through x2 with an increment (change language, color, etc) (col. 13, lines 1-5). 

As per claim 61, Paroz teaches a computer system wherein the canonical user interface 
description includes a description associated with a parameter type for the modification of a 
given first string s, resulting in a second string s' (change static text to something different)(col. 
11, 5-13). 

As per claim 62, Paroz teaches a computer system wherein the canonical user interface 
description includes a description associated with a parameter type for ordering the elements of 
set A into A (layout manipulation) (col. 11, 5-13). 

As per claims 65 and 66, Paroz teaches a computer system wherein the canonical user 
interface description includes a description associated with a command construct that specifies at 
least one action to be sent to the controlled element that will carry out the action command and a 
computer system wherein the canonical user interface description includes a description of the 
parameters associated with the at least action (output sent to and from computing devices, user 
input is recognized) (col. 11, lines 23-54). 
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As per claims 1-17, 20, 21, 24 and 25 they are the method claims of claims 42-58, 61, 62, 
65 and 66 and are rejected on the same basis. 24. As per claims 26 and 27, they are the computer 
readable medium and modulated data signal claims of claim 42 and are thus rejected on the same 
basis. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 59-60, 63-64 and 18-19, 22-23 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Paroz (US 6,587,125). 

As per claims 59 and 60, in addition to what has been discussed for claim 42, Paroz does 
not specifically disclose the limitation of a computer system wherein the canonical user interface 
includes a description associated with a parameter type for an arbitrary string s or wherein the 
arbitrary string s is to be selected from a suggestion set of strings S. However, Official Notice is 
taken that selecting a string from a set of strings is well known in the art, particularly in personal 
digital assistants, therefore it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to incorporate string selection in order to allow the user to select 
text commands with ease. 

As per claim 63, in addition to what has been discussed for claim 42, Paroz does not 
specifically disclose a computer system wherein the canonical user interface description includes 
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a description associated with a pai'ameter type for pairing set A elements with set B elements. 
However, Official Notice is taken that it pairing element in a GUI is well known in the art, 
therefore it would have been obvious to one of ordinary skill in the art at the time the invention 
was made to pair various elements in the user interface together in order to create an image that 
might improve the usability of the interface. 

As per claim 64, in addition to what has been discussed for claim 42, Paroz does not 
specifically disclose a computer system wherein the canonical user interface description includes 
a description associated with a group construct that contains at least one of commands and 
subgroups. However, Official Notice is taken that creating subgroups in within interface 
subgroup is well known in the art, paiticularly in the interface design of a personal digital 
assistant therefore it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate sub-grouping in order to create a more appealing navigation 
system for the user. 

As per claims 18-19, and 22-23, they are the method claims of claims 59-60 and 63-64, 
and are rejected on the same basis. 

Response to Argument 

6. Applicant's arguments filed on 2/27/2004 have been fiilly considered but they are not 
persuasive. 

Applicant argues the following: 

A) Paroz does not disclose instantiating a concrete UI using the UC to take into account 
stored user preferences. 
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A) Paroz allows the user to customize the window size, font language, and color of the 
display DHTML page. These customizations affect the appearance of the DHTML pages that 
are generated according to the second computing (e.g., Palm-Pilot, Cell phone) (col. 8, Hnes 56- 
68). Generation of the DHTML pages associated the user interface with the user console. The 
personal customization concreted user interface with the user console. The customizations of 
the DHTML are user's preference and user's description of what the page should look like. 

B) Applicant also argues a blind person could not use Paroz' s invention to control a 
multitude of computing devices such a TV, a VCR, and a microwave. 

B)In response to applicant's argument that the references fail to show certain features of 
applicant's invention, it is noted that the features upon which applicant relies (i.e., device that 
can be operated by a blind person) are not recited in the rejected claim(s). Although the claims 
are interpreted in light of the specification, limitations from the specification are not read into the 
claims. See In re Van Gems, 988 F.2d 1 181, 26 USPQ2d 1057 (Fed. Cir. 1993). 

6. TfflS ACTION IS MADE FINAL. Apphcant is reminded of the extension of 
time policy as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event. 
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however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Peng Ke whose telephone number is (571) 272-4062. The 
examiner can normally be reached on M-Th and Alternate Fridays 8:30-5:00, 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine L Kincaid can be reached on (571) 272-4063. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an apphcation may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Pubhc PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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